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GRAPH LAPLACIANS AND DISCRETE REPRODUCING KERNEL 
HILBERT SPACES FROM RESTRICTIONS 

PALLE JORGENSEN AND FENG TIAN 


Abstract. We study kernel functions, and associated reproducing kernel Hilbert spaces 
^ over infinite, discrete and countable sets V. Numerical analysis builds discrete models 
(e.g., finite element) for the purpose of finding approximate solutions to boundary value 
problems; using multiresolution-subdivision schemes in continuous domains. In this paper, 
we turn the tables: our object of study is realistic infinite discrete models in their own right; 
and we then use an analysis of suitable continuous counterpart problems, but now serving 
as a tool for obtaining solutions in the discrete world. 
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1. Introduction 

In a number of recent papers, kernel tools have found new applications, and a number of 
them depend on an interplay between continuous vs discrete; so between, (i) more classical 
continuous kernel models, and (ii) various discretization procedures; see the citations below. 
Applications of kernel tools include optimization, maximum-likelihood constructs, and machine 
learning models; they all entail a combination of analysis tools for a variety of reproducing 
kernels, and the associated reproducing kernel Hilbert spaces (RKHS); as well as probabilistic 
sampling and estimation; - all issues involving theorems for RKHSs. So far the emphasis has 
been on the continuous models, and we shall turn the table in the present paper. We shall 
make use of a class of discrete RKHSs which are typically associated with Gaussian free fields, 
and determinantal point process, and associated determinantal measures. The purpose of our 


2000 Mathematics Subject Classijication. Primary 47L60, 46N30, 65R10, 58J65, 81S25. 

Key words and phrases. Reproducing kernel Hilbert space, discrete analysis, graph Laplacians, distribution 
of point-masses. Green’s functions. 


1 



2 


paper is to offer a systematic approach to these questions. Our approach is motivated in part 
by the way the classical Cameron-Martin RKHS is used in the analysis of Brownian motion, 
and related Gaussian processes. We are concerned with a characterization of those RKHSs 3^ 
of functions, on some state space V, which contain the Dirac masses 8^ for all points x in V. 

Our setting is that of infinite discrete models vs their continuous counterparts. Our discrete 
analysis setting is as follows: Given is an infinite set V of vertices, and a set E of edges, 
contained in R x V\ {the diagonal}. Further, a positive symmetric function c on i? is prescribed 
(c is conductance in electrical networks), and there is a resulting graph Laplacian. Its spectral 
theory will be considered. In this setting, we arrive at a host of network models, whose analysis 
all involve kernels. Gonnectedness for our infinite graphs will be assumed. The relevant RKHSs 
are certain discrete Dirichlet spaces J^e,c) consisting of finite energy-functions, and modeled 
on the classical Gameron-Martin spaces; these discrete variants are Hilbert spaces of functions 
on V (modulo constants), and depending on the choice of {V,E,c). It is always the case that 
the differences f (x) — f {y) for / in J^e,c): for any given pair of vertices x and y, is well 
behaved: The differences (voltage-drop) will be represented by a kernel (in J^(^e,c)), depending 
on the pair x, y. By contrast, point-evaluation itself (for a single vertex) does not automatically 
have a kernel representation by a function in 3^(^e,c)- 

Our first result (Theorem 2.9) gives a necessary and sufficient condition for existence of 
J^£;_c)-kernels for point-evaluation, so a kernel associated to a fixed vertex xq. It follows from 
this that, when a vertex Xq is given, the answer to this question involves the entire vertex-set 
V, so including distant vertices and also boundary considerations. The question of deciding 
existence of finite-energy point-kernels has applications. For example, each setting sketched 
above gives rise to an associated Markov chain model involving a reversible random walk. It 
is known that the random walk is transient if and only if finite-energy point-kernels exist. 

In Sections 4-6, we turn to a family of generalized Gameron-Martin spaces; - in Theorems 
4.13 and 6.8, we give an explicit comparison between the continuous vs the discrete variants. 

A reproducing kernel Hilbert space (RKHS) is a Hilbert space of functions on a prescribed 
set, say V, with the property that point-evaluation for / S Jif is continuous with respect to 
the .^-norm. They are called kernel spaces, because, for every x G V, the point-evaluation 
for functions / € f (x) must then be given as a .x^-inner product of / and a vector kx, in 
called the kernel. See (2.4) below. 

Background. RKHSs have been studied extensively since the pioneering papers by Aron- 
szajn in the 1940ties, see e.g., [Aro43, Aro48]. They further play an important role in the 
theory of partial differential operators (PDO); for example as Green’s functions of second or¬ 
der elliptic PDOs; see e.g., [Nel57, HKL+14, Tre06]. Other applications include engineering, 
physics, machine-learning theory (see [KHll, SZ09, GS02]), stochastic processes (e.g., Gauss¬ 
ian free fields), numerical analysis, and more. See, e.g., [AD93, ABDdS93, AD92, AJSV13, 
AJV14, BTA04]. Also, see [LB04, HQKLIO, ZXZ12, LPll, Vull3, SS13, HN14]. But the 
literature so far has focused on the theory of kernel functions defined on continuous domains, 
either domains in Euclidean space, or complex domains in one or more variables. For these 
cases, the Dirac 5x distributions do not have finite J^-norm. But for RKHSs over discrete 
point distributions, it is reasonable to expect that the Dirac 5x functions will in fact have finite 
J^-norm. 

Here we consider the discrete case, i.e., RKHSs of functions defined on a prescribed countable 
infinite discrete set V. We are concerned with a characterization of those RKHSs which 
contain the Dirac masses Sx for all points x € V. Of the examples and applications where 
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this question plays an important role, we emphasize two: (i) discrete Brownian motion-Hilbert 
spaces, i.e., discrete versions of the Cameron-Martin Hilbert space [Fer03, HH93]; (ii) energy- 
Hilbert spaces corresponding to graph-Laplacians. 

Our setting is a given positive definite function k onV xV, where V is discrete (see above). 
We study the corresponding RKHS Jf’ (= Jf (k)) in detail. 

A positive definite kernel k is said to be universal [CMPY08] if, every continuous function, 
on a compact subset of the input space, can be uniformly approximated by sections of the 
kernel, i.e., by continuous functions in the RKHS. We show that for the RKHSs from kernels 
kc in electrical network G of resistors, this universality holds. The metric in this case is the 
resistance metric on the vertices of G, determined by the assignment of a conductance function 
c on the edges in G, see Section 6 below. 

The problems addressed here are motivated in part by applications to analysis on infinite 
weighted graphs, to stochastic processes, and to numerical analysis (discrete approximations), 
and to applications of RKHSs to machine learning. Readers are referred to the following papers, 
and the references cited there, for details regarding this: [AJS14, AJ12, AJLll, JPT15, JP14, 
JPlla, DG13, Krel3, ZXZ09, Nas84, NS13]. 

Infinite Networks. While the natural questions for the case of large (or infinite) networks, 
“the discrete world,” have counterparts in the more classical context of partial differential 
operators/equations (PDEs), the analysis on the discrete side is often done without reference 
to a continuous PDE-counterpart. 

The purpose of the present paper is to try to remedy this, to the extent it is possible. We 
begin with the discrete context (Theorem 2.9). And we proceed to show that, in the discrete 
case, our analysis depends on two tools, (i) positive definite (p.d.) functions, and associated 
RKHSs, and (ii) (resistance) metrics. Both may be studied as purely discrete objects, but 
nonetheless, in several of our results (including the corollaries in Sections 5 and 6), we give 
contexts for continuous counterparts to the two discrete tools, (i) and (ii). We make precise 
how to use the continuous counterparts for computations in explicit discrete models, and in 
the associated RKHSs. 

In Theorems 4.13 and 6.4 we give such concrete (countable infinite) discrete models which 
can be understood as restrictions of analogous PDE-models. In traditional numerical anal¬ 
ysis, one builds clever discrete models (finite element methods) for the purpose of finding 
approximate solutions to PDE-boundary value problems. They typically use multiresolution- 
subdivision schemes, applied to the continuous domain, subdividing into simpler discretized 
parts, called finite elements. And with variational methods, one then minimize various error- 
functions. In this paper, we turn the tables: our object of study are the discrete models, and 
analysis of suitable continuous PDE boundary problems serve as a tool for solutions in the 
discrete world. 


2. Discreteness in reproducing kernel Hilbert spaces 

Definition 2.1. Let K be a set, and (V) denotes the set of all finite subsets of V. A 
function k ■. V x K —>■ C is said to be positive definite, if 

k{x,y)'^Cy>0 ( 2 . 1 ) 

{x,y)GFxF 

holds for all coefficients {cx]x&f C C, and dl\ F & ^ (V). 

Definition 2.2. Fix a countable infinite set V. 


(1) For all X €V, set 


kx '■= k {■, x) : V ^ C 


( 2 . 2 ) 


as a function on V. 

(2) Let Jif := Jif (k) be the Hilbert-completion of the span{kx '■ x GV}, with respect to 
the inner product 

l'^Cxkx,'^dyky\ :='^'^^dyk{x,y), F G ^ {V), (2.3) 

\xGF yGF / FxF 

modulo the subspace of functions of zero c;?^-norm, i.e., 

'^Y^F,Cyk{x,y) = 0 . 

FxF 

Jif is then a reproducing kernel Hilbert space (RKHS), with the reproducing property: 

{kx, p)^ = ^{“x), Vx G V, yip G Jf’. (2.4) 

(3) If F" G (V), set = closed spanj/c^^lxGF C (closed is automatic as F is 
finite.) And set 

Pp := the orthogonal projection onto Jifp. (2-5) 

Remark 2.3. The summations in (2.3) are all finite. We use physicists’ convention, so that the 
inner product in (2.3) is conjugate linear in the first variable, and linear in the second variable. 


We shall need the following lemma: 


Lemma 2.4. Let k : V x V ^ C he a positive definite kernel, and let be the corresponding 
RKHS. Then a function ^ on V is in JiF if and only if there is a constant C < oo such that, 
for all finite subsets F C V, and all {cx}„,^p CC*^, we have: 


Cxf. (x) 

xGF 


2 

yk{x,y). 

FxF 


( 2 . 6 ) 


Proof. See [Aro48]. 


□ 


A reproducing kernel Hilbert space (RKHS) is a Hilbert space of functions on some set S. 
If S comes with a topology, it is natural to study RHHSs Jif consisting of continuous functions 
on S. If k is continuous on S' x S', one can show that then the functions in JF (fc) are also 
continuous. Except for trivial cases, the Dirac “function” 


dx {y) = 


y = x 

y^x 


(2.7) 


is not continuous, and as a result, 5x will typically not be in JF. But the situation is different 
for discrete spaces. 

We will show that, even if S is a given discrete set (countable infinite), we still often have 
5x ^ ^ for naturally arising RKHSs M’] see also [JT15]. 

Below, we shall concentrate on cases when S' = R is a set of vertices in a graph G with 
edge-set E C V x R\ (diagonal), and on classes of RKHSs of functions on V, for which 
Sx G for all X gV. 
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Definition 2.5. The RKHS (in Def. 2.2) is said to have the discrete mass property if 
5x G for all X €V. M’ is then called a discrete RKHS. 

The following is immediate. 

Proposition 2 . 6 . Suppose is a discrete RKHS of functions on a vertex-set V, as described 
above; then there is a unique operator A, with dense domain dom (A) C , such that 

(A/) (x) = {6x, f)jif , for all x G V, and all f G dom (A). (2-8) 

The operator A from (2.8) will be studied in detail in Section 5 below. In special cases, it is 
called a graph-Laplacian; and it is a discrete analogue of the classical Laplace operator —V^. 

Corollary 2.7. Let k : V x V —>■ C, ffV = Hq, be a positive definite function, and let Jif be 
the corresponding RKHS. Assume 5x G M’ for all x G V; then there are closable operators 

Jff {V), and f {V) A Jif, (2.9) 

such that T C S*, S C T*; and 

T kx = Sx, S 6x = Sx, for all x G V. (2.10) 

Proof. By assumption, S and T are well defined as specified in (2.9)-(2.10), with 
dom (T) = span{kx '. x GV'\ dense in and 
dom (S) = span{Sx '. x gV} dense in P (V). 

By Proposition 2.6, we have 

{Tf,ip)i, = {f,S^)^, ( 2 . 11 ) 

for all / G dom (T) C and all ip G dom (S) C P. 

The conclusions T C S*, and S C T*, follow from (2.11). Since each operator S and T 
has dense domain, it follows that both T* and S'* must have dense domains in the respective 
Hilbert spaces, i.e., dom (T*) dense in P, and dom (S*) dense in M’. □ 

Remark 2.8. As a result, we conclude that T*T is a selfadjoint extension of the operator A 
from Proposition 2.6. 

Theorem 2.9. Given V, and a positive definite (p.d.) function k : V x V ^ M., let 
Jif {= (k)) be the corresponding RKHS. Fix Xi G V; then the following three conditions 
are equivalent: 

(1) ^xi € >' 

(2) 30 < Cx^ < oo, such that 

EE? {x)fiy)k{x,y) (2.12) 

FxF 

holds, for all F G (P), and all functions ^ on F. 

(3) For F G^ {V), set 

AIf := (fc (a^, ?/))(a;_j,)gFxF ’ (2.13) 

as a ffF X ffF matrix. Then 

sup [Kp^Sx^] (xi) < oo. (2.14) 

F^3F{V) 
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Proof. (1)=>(2) We use Lemma 2.4. Let ^ be any function on F G ^ (y), and set 

h ■= L! ( 2 /) ^ 

yeF 

where ky (•) := k (•, y), as in (2.2). 

Since 5xi G Jif, we have 


by (2.4) 


by (2.7) 


^ ^ ? (y) i^xi j f^y) 

yeF 

F ^ (2/) 

yeF 


C(a^i)- 

Moreover, the Cauchy-Schwarz inequality implies that 

I 12 

I j I ^ 


\\Sx,f^\\hr^ 


\xeF yeF 

FxF 

Therefore (2.12) follows from (2.15) and (2.16), with Cx^ '■= \\Sxi\\%>- 
(2)=>(3) Recall the matrix 


je 


(2.15) 


(2.16) 


Kp :— ((fca;, fcy))(2,_y)g^xF 
as a linear operator l'^ (F) —)■ P (F), where 


(Kptf) {x) = ^Kp (x, y)(p{y), tp G P (F). 

(2.17) 

yeF 


By (2.12), we have 


ker (Kp) C {(p G P (F) : (p (xi) = O} . 

(2.18) 

Equivalently, 


ker(R:F) C 

(2.19) 

and so dx^ G ker {Kp)^ = ran {Kp), and 3 G P {F) s.t. 


^=^^F=Fy^pF'> (2/)^(b2/)- 

(2.20) 


^'.hfr 

Claim. Pp ((5a;j) = hp, where Pp = projection onto J^p. 

Proof of the claim. We only need to prove that Sx^ — hp G Jif 0 Jifp, i.e., 

(4i-/iF,fc.)^ = o, VzeF. (2.21) 


But, by (2.20), 


lhS(2,2i) = Sx,,.-J 2 k (0 y) (y) = «• 

yeF 


□ 
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Monotonicity: If F C F', F,F' £ ^ (y), then C and PpPp' = Pp by easy facts 
for projections. Hence 

WPpSxiW^ ^ \\Pf'Sxi\\^ , hp ■= Pp (Sxi) (2.22) 

and 

\\^JSx,-hF\\^ = 0. (2.23) 

Details: Since {kx}^^Y spans a dense subspace in by definition of as a RKHS, we 
conclude that 

Ijg’ = sup{Pf \ F £ ^ {V)} 

where denotes the identity operator in JF. We also use that the system of projections 
{Pp \ F £ ^ (^)} is a monotone filter in the following sense: 

li F,G £ ^ {V), satisfying F C G, then since span {k^ | a; G F} C span {ky \ y £ G}, we get 
PpJ^ C PqJ^, or equivalently Pp < Pq, which is the same as Pp = PpPc = PgPf- Hence 

\\PGh\\%^ = \\PFh\\%, + ||Fl/i||^ > ||Ff/i||^ 

holds for all h £ Jf. The desired conclusion (2.23) follows. 

Also note that 


||^V(<5xi)||_^ — (^xi,Pf{5xi)) jfp 

= Kp^ (a;i,a;i) = (a;i) < oo, 

which is (3). 

(3)=4>(1) The argument from above shows that, for all x £ V, and all e > 0, there exists 
Fq £ ^ (V) such that, for all F,F' £ ^ (V), F D Fg, F' D Fg, we have 


Whp - hp-Wj^ < e, 

where (see (2.20)) 

Sxi\p = =hF\p, and 

1^, = Kf'C^^ ^ = kF'\p,. 

Passing to the limit in the filter (of finite subsets) ^ {V), we now conclude that the limit 
Sxi £ which is the desired conclusion (1). For more details, we refer to [JT15]. □ 


If the condition in Proposition 2.6 is satisfied we get an associated operator A as specified 
in (2.8). But without additional restrictions on = JF {k,V) it is not automatic that A 
maps into 


Theorem 2.10. Let k : V x V ^ C be a positive definite kernel, and let Jif = Jif {k, V) be the 
corresponding RKHS. Assume that 6x £ -AP for all x £V, so A (as in (2.8)) is well defined. 

Then Akx = Sx (G Aif) for all x £ V, and so A is a densely defined Hermitian symmetric 
operator in M’. 


Proof. Let xq £ V, then Akxg £ Aif holds if and only if there is an e > 0 such that the following 
xg-modified kernel is positive definite, where 


(x, y) = 


k{x,y) if (x,y) (xo, 2 /g) 

fc (Xg, j/g) - e if (x, y) = (xg, yg). 
We shall now show that this holds; it is an application of Theorem 2.9. 


(2.24) 
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Let k, V, and a;o S be as in the statement of the theorem. Now consider the function 


C — ^kxQ ■ 


Step 1. We use Lemma 2.4: To show that ^ is in Jif, we shall verify a variant of the 
estimate (2.12) from Theorem 2.9. Consider all finite sums as follows, and the stated a priori 
estimate: 


(2^) 

y&v 


< C'^'^\yX:,k{y,z) , 
y,z 


(2.25) 


VAy S C, finite support y £ V, where C < oo depends only on xq- We shall take e = C ^ in 
(2.24). 

Step 2. We have 

Hy) = Sy,xo, y&v. (2.26) 

Verification of (2.26): We have 


^ {y) = i^kxo) (j/) = , {Sy, kxo) = Sxo,y 

by (2.8) 


as claimed in (2.26). We used that kxg has the reproducing property, and that 6y G Jf for all 
y £ V. 

Hence we may apply Theorem 2.9, (2)<^=^(1), to conclude that ^ = Akxg £ But, by 
Step 2, we also have ^ = Sxg (£ and so = Sxgi which is the desired conclusion. □ 


3. Infinite networks 

In the section above we studied the discreteness property in the general setting of repro¬ 
ducing kernel Hilbert spaces (RKHS). Below we turn to our main application: Those RKHSs 
which arise in the study of infinite network models; see e.g., [CJll, JPllb, JT15]. By this we 
mean infinite graphs G = (V, E), with specified sets of vertices V, and edges E (see Definition 
3.2). While such network models G have been previously studied in the literature, see e.g., 
[JPIO], our present setting is more general in a number of respects; especially in that our 
present setting, vertex points may have an infinite number of neighbors, i.e., there may be 
points X in V with an infinite number of edges {xy). 

Remark 3.1. Our present paper has 3 different settings of generality: 

(1) The RHKSs in general; 

(2) The special RKHSs which has the discrete mass property (Definition 2.5), i.e., 
containing all the Dirac masses. 

(3) The RKHSs from infinite network models {V,E,c), where V consists of vertices, E is 
the edge-set in V x V\ {diagonal}, and c is a prescribed conductance function on E. 

(Note that (3) is a special case of (2), and (2) is a special case of (1). See details below.) 


In general, iffc:VxV—^-Cisa p.d. function, we get = RKHS (fc, V). 

In Theorem 2.10, we showed that if Jif is special, having the discrete mass property (Def¬ 
inition 2.5), i.e., Sx £ for all x £V; then we may consider the function 

{Af)ix):={SxJ)^ (3.1) 

as in (2.8). But it is not guaranteed that the function V ^ x —> (A/) {x) will be in In 
the proof of Theorem 2.10, we showed, using Lemma 2.4, that the operator A in (3.1) indeed 
maps into JXE. 
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Consequently, setting dom{A) = span{kx : x^V}, Ak^ = Sx, it follows that 

{Akx^ fcy) ^ {kx') Aky')^ ^x,yj y ^ 

and so A is a densely defined Hermitian symmetric operator in 

Now, specialize to our infinite network models. Let (V,E,c) be as above; pick a base-point 
o G V. Set 

y':=y\{o}. (3.2) 

By Riesz’ theorem (see also [JPIO, JPllb]), there exists Vx '■= Vx,o-i such that 


f (x) - f {o) = {vx,f)j^ (3.3) 

valid for all / G and all x G V'. We may further assume that Vx (o) = 0, a; S V. The 
functions Vx are called dipoles. 

Consider the energy Hilbert space, with inner product defined by 

W)- (3.4) 

(s,t)GE 


Set 


(a;, y) := {vx, Vy){vx (s) - Vx (t)) (vy (s) - Vy {t)) 
= Vx{y), yx,yGV'; 


(3.5) 


where we have used the property from (3.3). 


Definition 3.2. Let P be a set, = Hq, and let if C P x P\ {diagonal}. Let c : if —>■ [0, oo) 
be a fixed function. We assume that for any pair x,y gV 3 {xi}^^^ C V s.t. (a:i,a:i+i) € if, 
xo = X and Xn = y. 

For functions on P, we introduce the following equivalence relation 

fi ~ /2 fi - fi is constant on P. 

Def 

On the set of equivalence classes, we define the c-energy 

- fiv)? < oo; 

{x,y)eE 

see (3.4)-(3.5). 


With the corresponding inner product, this becomes a Hilbert space denoted M’e.c- 
Using this and Riesz, we showed that, for all x,y GV , 3! Vxy G s.t. 

f (x) - f (y) = {Vxy,f)_^^^, fGM’E,c- (3.6) 

Fix a base-point o gV , and set 

k^ ^ {x,y) = {vxo,Vyo) ■ (3.7) 

Then k^‘^^ is a positive definite kernel, and we get a canonical isomorphism 

RKHS(A:(")) - {/ e : / (o) = 0} . 

We normalize with Vx^o (0) = 0. 
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Corollary 3.3. Let V, E, c and M'e,c be as in Definition 3.2, then, for x G V, class {6x) G J^e,c 
holds, if and only if, 

c{x) := ^ Cxy < oo. 

v&v 

{x,y)eE 

In this case, 

=c{x). 

Proof. The result is immediate from Theorem 2.9; see especially (2.14). □ 


4. Discrete RKHSs as restrictions 


Given a discrete set V, ffV — Hq, let Ky : G x F —>■ C (or M) be a positive definite (p.d.) 
function, and Jify = (Ky) the corresponding RKHS. We study when 6x is in for all 
X G V. 

We show below (Theorem 4.13; also see Section 5) that every fundamental solution for a 
Dirichlet boundary value problem on a bounded open domain Ll in allows for discrete 
restrictions (i.e., vertices sampled in Lt), which have the desired “discrete mass” property (see 
Definition 2.5). 

Remark A.1. To get the desired conclusions, consider a continuous p.d. function RT : 14x17—J-K, 
and an ONB for Jif (K) = RKHS = CM (Cameron Martin Hilbert space; see Section 

4.2.) We need suitable restricting assumptions on the prescribed set 17 C 

(i) open 

(ii) bounded 

(iii) connected 

(iv) smooth boundary 917 

(Some of the restrictions on 17 may be relaxed, but even this setting is interesting enough.) 

The conditions (i)-(iv) are satisfied by the covariance function k {s,t) = s A 7 — on 17 x 17, 
17 = (0,1) C M, for Brownian bridge (Examples 4.2 and 6.6). By contrast, we also have the 
covariance function k{s,t) = s At for the Brownian motion, and in this case, we may take 
17 = IR+, or 17 = K; and these are examples with unbounded domains 17 C 


(4.1) 


4.1. Examples from elliptic operators. Given a bounded open domain 17 C let 

A=-i:(0=-v^ 

i=i ^ ^ ^ 

with corresponding Green’s function K, i.e., the fundamental solution to the Dirichlet bound¬ 
ary value problem, so that RT : 17 x 17 —)■ C, ART (s, •) = Ss, and K (s, •) |aa = 0. 

We assume that 17 C has finite Poincare constant Cp, i.e., we have: 


f\ffdx<Cp\ f fdx +f\Vffdx\, 'ifGM’cMm-, 
Jn ( ia Jn J 


(4.2) 


see [Ami78, DL54]. 


Example 4.2 (Brownian bridge). For = 1, 17 = (0,1), then 

k{s,t) = s At — st] 

is the covariance function of the Brownian bridge. 


(4.3) 
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Proposition 4.3. Let Lt = (0,1), and k : fl x LI ^ M. be the covariance function in (4-3) ■ Set 
ks {t) := k (s, t), for all s,t G Ll. Then, the function ks satisfies: 

2 


ks (0) = ks (1) = 0, and — 


ks = S {s - t). 


(4.4) 


Proof. Direct verification, see [JT15]. Sketch: Fix s, 0 < s < 1, then 

t(l — s) 0<t<s 


ks ft) = 


s (1 — t) s < t < 1 


and (see Fig 6.2) 


dt 


ks (t) = 


1 — s 0<t<s 
—s s <t < 1 
= - s) X(0,s) (t) - SXis,l) {t) 


— ] ks{t) = - {1 - s) Ss - s6s = -Ss; 


□ 


or equivalently, AK = S (t — s), where k is as in (4.3). 

Example 4.4 (Discrete version). Fix R s.t. 0 < i? < 1, set V = Z+ and conductance 
Ciy+i = i?“*. Then the energy-Hilbert space consists of functions / on s.t. 

lim / (z) = 0, and 


-| 

wfwlifR = 1-^ w - / (* -1)1^ < 

and graph-Laplacian 

(Ad^scf) (*) = (/ (*) -/(*-!)) + R-^ (/ (*) -/(» + !)). 

In this case, the reproducing kernel k^ is as follows: 

mxj 

kniij) = V(i, j) S Z+ x Z+. 

Here is a system of functions in such that (nf, /)^ = / (*)> € ^R- 


(4.5) 

(4.6) 

(4.7) 

(4.8) 


Higher dimensions. Let LI C bounded and open s.t. dLl is smooth. Set 
Ao := -^ , (see (4.1)) with 




(4.9) 


dom (Ao) = {f e L'^ {LI) | A/ S (H), and = 0} . 

We have that Aq is selfadjoint in (fl) and that 

Ao > 0 on c?om(Ao); (4-10) 

i.e., {(p, A^ip) > 0, V(/3 € dom(Ao); and we therefore get its kernel K (analogous to (4.4) 
in Example 4.2 (Brownian bridge).) By (4.9)-(4.10), 

St = 6-*^“ : {LI) ^L^{Ll), t > 0 
is a s.a. contractive semigroup. 
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Let 


K = 


pOO 

/ e-*^°dt : (ft) ^ (n) 

Jo 


(4.11) 


as an operator, generally unbounded. Since Aq is elliptic, we further get that K is represented 
as 


{Kf ){x)= f K{x,y)f{y)dy 
Jn 

where the integral in (4.12) is w.r.t. Lebesgue measure in 
Lemma 4.5. Let K he the kernel in (4-11), then 

AqK = I on (LI). 

Moreover, K : Q x LI is continuous, and p.d., i.e., 

(a:j,a;j) > 0 


(4.12) 

(4.13) 

(4.14) 


* j 


for all coefficients C M, and all C LI. 

Proof. Let P 2 (dX) denote the spectral resolution of Aq (projection valued measure (PVM)), 


i.e., 


so that 


P 2 (A) = P 2 (A)* = P 2 {Af 
P2 {AlB)=P 2{A)P2{B), \fA,Be 


Ao = / XP2 (dX) 
Jo 




and 


pOO 

-^^0 = / e-*^dP2 (A), t>0 

Jo 

r°° 1 

K = -P 2 (dX) = A, 


-1 

0 


(4.15) 


(4.16) 


(4.17) 


(in general an unbounded operator.) 

To see that K is p.d. (see (4.14)): 

Step 1. If tp S Cf° (n); then (enough to consider the real valued case) 


/ / K {x,y)(p{x)(f{y)dxdy 

Jq Jq 

poo 1 

= {P,Kip)^ = - IIP 2 (dA)v5||2 > 0. 


Step 2. Approximate (Sx) with Cf° (LI). 


□ 


Corollary 4.6. Let Aq, and Ll be as in Lemma f.B. Then we have a system of kernels pt (x, y), 
t > 0, {x,y) G Ll X 17, such that 

(1) Po {x,y) = 6x,y; 

(2) Pt {x, •) S L^ (Ll) for all t G M+, x G Ll; 

(3) each pt (•, •) is a positive definite kernel on Ll x Ll; 
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(4) for s,t G [0, oo), we have 

Ps+t{x,v)= / ps{x,z)pt{z,y) dz; and 
Jn 

(5) the kernel K from (4-17) satisfies 


K{x,y)= Pt{x,y)dt, y{x,y)Gnxn. 

JO 

Proof. Immediate from the lemma and an application of the Spectral Theorem. □ 

Remark 4.7. The conclusions in the corollary are also valid in our discrete models, {V,E,c), 
E C V X y\ {diagonal}, and c defined on if as in Definition 5.1 below. In this case, 

(Ao/)(x)= ^ c,y{f{x)-f{y)), fGl\V)-, (4.18) 

y 

{x,y)^E 

g-tAo . p tG M+; (4.19) 

{e~*^°f){x) = '^pt{x,y)f{y), ^ f G f {V), t G R+-, (4.20) 

v&v 

and (analogous to (4) in the corollary), we have: 

Ps+t{.x,y) = '^Ps{x,z)pt{z,y), \/ {x,y) G V x V, Vsp G [0,oo). (4.21) 

zev 


Corollary 4.8. Let K he as in (4.11), then K satisfies that AK = 5 {x — y) on LI x LI, and 
K {x, •) |on = 0. 


Proof. By well-known facts from elliptic operators, the conclusion is equivalent to (4.13). □ 

Lemma 4.9. Let k : LI x LI ^ C be a p.d. kernel, and let M’ = jLf {k) be the corresponding 
RKHS. Then for every subset V C LI, = |/|,. ; / G is a RKHS Jify; and if (p G J^, 
then \\p\\^^ = inf {||/||^ : f G Jf, f\^ = p}. 

Proof. See [Aro43, Aro48]. Consider Jif 0 jLy (closed), where jVy = {/G^;/|y = 0}- 


Moreover the inf is attained; / G Jf. □ 

Corollary 4.10. Let k, V, and J4f = (fc) be as above. For f G write 

f = fo + fi (4.22) 

w.r.t. the orthogonal splitting (two closed subspaces): 

Jif = .zVy 0 zVy~ , /o G My, fi G My*“, (4.23) 

then if p G -.7^, we have 

\\t\\.^v ~ (4.24) 

where p = f\y. 

Proof. With the splitting (4.22), we get f\y = /ij^; so 

= /|y =/i|y, and (4.25) 

\\f\\% = \\fo\\% + \\fi\\%>\\fi\\% 

so by (4.25), \\p\\j^^ = ||/i||^. □ 
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The purpose of the next section is to study these restrictions (discrete) in detail, from cases 
where M’ is one of the classical continuous RKHSs. 


4.2. The Cameron-Martin space J^cm The Cameron-Martin Hilbert space is a RKHS 
(abbreviated C-M below) which gives the context for the Cameron-Martin formula which de¬ 
scribes how abstract Wiener measure changes under translation by elements of the Cameron- 
Martin RKHS. Context: Abstract Wiener measure is quasi-invariant (under translation), not 
invariant; and the C-M RKHS serves as a tool in a formula for computing of the corresponding 
Radon-Nikodym derivatives, the C-H formula; see e.g., [HH93]. The technical details involved 
vary, depending on the dimension, and on suitable boundary conditions, see below. 

Let n C satisfying conditions (i)-(iv); i.e., is bounded, open, and connected in 
with smooth boundary dVl. 

Let AT : n X —)■ K continuous, p.d., given as the Green’s function of Aq, for the Dirichlet 
boundary condition, see (4.9). Thus, Aq is positive selfadjoint, and 


AK = 6 {x — y) on n X 

^ ') Ian “ ® 

see Corollary 4.8. 

Let JffcM {^) be the corresponding Cameron-Martin RKHS. 

For V = 1, Q = {0, 1), take 

^CM (0,1) ={/ I /' G L" (0,1), / (0) = / (1) = 0, 
ll/llcM — ^ \ffdx < ooj 

For V > 1, let 


J^CM {^) 


|/| V/GL2(f7), /|^^ = o, WfWl^ 

1 ^ ( 9 d d \ 

where V = —, —, • • • , ^— . 

\UXi UX2 C/Xjy J 


\Vf\ dx < oo 


(4.26) 

(4.27) 


(4.28) 


(4.29) 


Remark 4.11. In the case of = (0,1), = 1, and for K {s,t) = s At— st, we have JifcM (0,1) 

as in (4.28). The following decomposition holds: 


K {s,t) 


E 


sin (uTTs) sin (mrt) 
(nir)^ 


(s, t) G n X fi. 


Proof. Use Fourier series; or the fact that 

( sin (mrt) 
\ nn 

is an ONB in J^cm (0,1). 


□ 


In general, i' > 1, there exists ONB {fn}neN ™ ^CM (U) (see (4.29)), such that 

OO 

K {x, y) = (x) fn (y) on 0 X 0. 

n—1 

Proof. A result from the theory of RKHS. □ 
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Lemma 4.12 (The reproducing property). Let K be the kernel of Aq for the Dirichelet 
boundary condition; and let JifcM be the Cameron-Martin space in (4-29). Then 

{K,,f)cM = fix), yf (4.30) 


Proof. Note that 

LHS(4.30) 


(Vi^,) (V/) dy 


(by (4.26)) Jq 


- [ {V^K,)f{y)dy (by (4.27),(4.29)) 
Jn 

^K^f (y) dy 

[ ^{x-y)f{y)dy = f (x); 

Jn 


(by (4.26)) Jq 

where dy = dyidy 2 ■ ■ • dy^ denotes the Lebesgue measure in f2 C 


□ 


We shall now consider discrete subsets: 


Theorem 4.13. Let fl, and V C Ll, be given. Then 

(1) Discrete case: Fix V C LI, ffV = Hg, where V = Xj € LI. Let 

MT {V) = RKHS of 

then 5xj G (1^). 

(2) Continuous case; by contrast: G J^cm (V), but 6^ ^ J^cm (f^)) x G 12. 

The proof will be given in the next section. 

To see that 5^ ^ J^cm (^^)i we use (4.28) when v = \, and (4.29) when > 1. 

In general, by elliptic regularity, Mcm (12) is a RKHS of continuous functions; and 5x is not 
a function, so not in MTcm (12)- 

But the RKHS of := K\^.^y is a discrete RKHS, and 4 G ^ {V); proof below; 

Theorem 6.4. 


5. Infinite network of resistors 

Here we introduce a family of positive definite kernels A: : H x K —>■ K, defined on infinite 
sets V of vertices for a given graph G = {V,E) with edges E CV x K\(diagonal). 

There is a large literature dealing with analysis on infinite graphs; see e.g., [JPIO, JPllb, 
JP13]; see also [OS05, BCF+07, CJll]. 

Our main purpose here is to point out that every assignment of resistors on the edges E in 
G yields a p.d. kernel k, and an associated RKHS Jif = Jif (fc) such that 

6x G Jf, for all X gV . (5.1) 

Definition 5.1. Let G = {V,E) be as above. Assume 

1. {x,y) G E {y,x) G E] 

2. 3c : A —>■ K+ (a conductance function = 1 / resistance) such that 

(i) e^xy) e^yx^, y {xy^ G E, 

(ii) for all X G K, # {y G K I C(^xy) > 0} < oo; and 
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Figure 5.1. Examples of configuration of resistors in a network. 



Figure 5.2. Example of configuration of resistors in a “large” network. 

(iii) 3o e F s.t. for Mx S V\ {o}, 3 edges {xi,x *+i)o ' e E s.t. Xo = 0, and Xn = x\ 
called connectedness. 

Given G = {V, E), and a fixed conductance function c : E ^ IR+ as specified above, we now 
define a corresponding Laplace operator A = acting on functions on V, i.e., on J^unc (V) 

by 

(A/) {x) = c^y (/ (x) - / (y)). (5.2) 

yr^x 

See Fig 5.1-5.2 for examples of networks of resistors: Cxy = ^eslx y) ’ ^ 

Let be the Hilbert space defined as follows: A function / on F is in iff / (o) = 0, and 

Wfiilf ■= ~ f (y)i^ < (5-3) 

{x,y)eE 

CVXV 
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Lemma 5.2 ([JPIO]). For all x G P\ {o}^ 3vx G s.t. 

f{x)-f{o) = {v,,f)^, (5.4) 

where 

= yhj€J^. (5.5) 

{x,y)GE 

(The system {vx} is called a system of dipoles.) 

Proof. Let x G y\ {o}, and use (5.2) together with the Schwarz-inequality to show that 

1/ (x) - f{o)f <Y1 ~— . 

An application of Riesz’ lemma then yields the desired conclusion. 

Note that Vx = in (5.4) depends on the choice of base point o gV, and on conductance 
function c; see (i)-(ii) and (5.3). □ 

The resistance metric (a;, y) = res {x,y) is as follows: 

i?(^)(x,y)=inf{i^ : \f {x) - f {y)f < K \\f\\% , Wf G JT} 

= sup{|/(a;) - fiy)\ : f G JT, \\f\\_^ < 1}. 

Now set 

k^^Hx.y) = {vx,vy)^, V (xy) G (V\ {o}) X (R\ {o}). (5.6) 

It follows from a theorem that is a Green’s function for the Laplacian in the sense 
that 

A(-^'>k^^Hx,-) = Sx (5.7) 

where the dot in (5.7) is the dummy-variable in the action. (Note that the solution to (5.7) is 
not unique.) 

Finally, we note that 

Avx=Sx-So, Va;GR\{o}. (5.8) 

And (5.8) in turn follows from (5.4), (5.2) and a straightforward computation. 

Corollary 5.3. Let G = (V,E) xnd conductance c : E ^ IR_|_ be as specified above. Let 
A = be the corresponding Laplace operator. Let (A:°) be the RKHS. Then 

{5x,f)_^ = {Af){x) (5.9) 

and 

Sx — c (a:) Vx ^ ( CxyVy G (5.10) 

y~x 

holds for all X G V. 

Proof. Since the system {vx} of dipoles (see (5.4)) span a dense subspace in Jif, it is enough 
to verify (5.9) when f = Vy for y G R\{o}. But in this case, (5.9) follows from (5.7) and a 
direct calculation. (For details, see [JT15].) □ 
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Corollary 5.4. Let G = {V,E), and conductance c : E ^ IR+ be as before; let be 

the Laplace operator, and the energy-Hilbert space in Definition 5.1 (see (5.3)). Let 

{x,y) = ( Vx,Vy)^^ be the kernel from (5.6), i.e., the Green’s function of Then the 

two Hilbert spaces ,!^e, CL^d Jif ik^‘’'>^ = RKHS are naturally isometrically isomorphic 

via Vx I—>■ where kjf'^ = k^‘’^ [x, •) for all x G V. 


Proof. Let F G (V), and let ^ be a function on F; then 








FxF 


(5.6) 


I] (y) ( Vx^Vy) 

FxF 



2 


The remaining steps in the proof of the Corollary now follow from the standard completion 
from dense subspaces in the respective two Hilbert spaces M’e and □ 


In the following we show how the kernels kF^ : 1^ x F —)■ K from (5.6) in Lemma 5.2 are 
related to metrics on F; so called resistance metrics (see, e.g., [JPIO, AJSV13].) 

Corollary 5.5. Let G = (V, E), and conductance c : E ^ K+ be as above; and let k^”'^ {x, y) := 
i^xT^y) be the corresponding Green’s function for the graph Laplacian 
Then there is a metric R (= = the resistance metric'), such that 

fc(c) ^ (o, x) + (o, y) - [x, y) 

holds on V X V. Here the base-point o GV is chosen and fixed s.t. 

= fi^)-f (o ), V/ e Vx e K 

Proof See [JPIO]. Set 

{x,y) = \\vx-Vyf^^ . 

We proved in [JPIO] that R^”’^ ( x,y) in (5.13) indeed defines a metric on V; the so called 
resistance metric. It represents the voltage-drop from x to y when 1 Amp is fed into (G, c) at 
the point x, and then extracted at y. 

The verification of (5.11) is now an easy computation, as follows: 

R^‘’'> (o, x) -\- R^‘’'> (o, y) — {x, y) 

2 

2 

= {VxT'Vy)^^ 

= (by (5.6)). 

□ 


(5.11) 

(5.12) 

(5.13) 
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Figure 5.3. Brownian bridge B^ri (t), a simnlation of three sample paths of 
the Brownian bridge. 


Corollary 5.6. The functions (•, •) which arise as in (5.11) and (5.13) are conditionally 
negative definite, i.e., for all finite subsets F gV and functions ^ on F, such that = 

0, we have: 

(5.14) 

F F 

(Note that (5.1)) follows from (5.13).) 

Moreover, if arises as a restriction of a metric on then there is a quadratic form 
Q on (possibly Q = 0), and a positive measure p, on such that 

(o, x) = Q (a;) + /" cos (x 

Jm- Id 


where 


dp iO 

1 + ier 


< oo. 


Proof. For details on this last point, see for example [AJV14] and [BTA04]. 


(5.16) 

□ 


Proposition 5.7. In the two cases: (i) B (t), Brownian motion on 0 < t < oo; and (ii) the 
Brownian bridge Bbri (t), 0 < t < 1 , (see Fig 5.3) the corresponding resistance metric R is as 
follows: 

(i) IfV = C (0, oo), xi < X 2 < • • •, then 

R‘'g\xi,Xj) = \xi - Xj\ . ( 5 . 17 ) 

(ii) IfW = C (0,1), 0 < xi < X 2 < • • ■ < 1 , then 

di^bridge {x^,Xj) = \Xi -Xj\-{1- \x^ - Xj\) . ( 5 . 18 ) 

In the completion w.r.t. the resistance metric R^^g^,, the two endpoints x = 0 and 
X = 1 are identified; see also Fig 5.3. 


The Brownian bridge B^ri (t) is realized on a probability space 17 (~ C ([0,1])) snch that 
Bbri (0) = Bbri (1) = 0, and 

E {Bbri (s) Bbri (t)) = s At - st = ks {s,t) , 
where £(•••) = /q ''' dP, and P denotes Wiener measnre on 17. 


(5.19) 
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Figure 6.1. Vz, # {j s.t. (xiXj) G E} < oo, every vertex Xi has a finite set of neighbors. 


denotes the usual Brownian motion, B (0) = 0, with covariance 

E{B{s)B{t))=sAt; (5.20) 

then we may take for B^ri (t) as follows: 


Bbri (t) = (l-t)B 


1 - t 


, Vte(0,l). 


(5.21) 


6. The Discrete RKHSs Jff {V) from Brownian motion 

Let V, K be as above. To get that 5^^ € Jf’ (V), we may specify a graph G = (V, E) with 
vertices V and edges E C V x y\ {diagonal}, and assume that, for all Xi € R, 

# {xj \xi ^ Xj'^ < oo, Vxi S V (6.1) 

(finite neighborhood set); see Fig 6.1. Fix a base-point o € V. 

Set ■= all functions f on V s.t. / (o) = 0, with 


ls = —7^l/(^i)-/(a;j)|^; 

2^^(z, j) 


where res (i,j) denotes resistance between Xi and Xj, and 

1 


res(i,j) 

is the conductance. Then {G) is a RKHS for the graph G = (V, E), i.e., the energy Hilbert 
space. 

Note that 


and 


iF,. -Kix,,-) ^ G ^e(G) 


Vx, G R, V/e JTs (G). 
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Lemma 6.1. The mapping Pq '■ CM (12) —>■ J^e (G), '—> Kx^, defines a projection of the 

Cameron-Martin space (see (4.29)) onto M’e (G). 


Proof. Note that Jy ■ MTe (G) —>■ CM (12), JyKxj = Kx-, 
that 



2 

J^EiG) 



is an isometry. 
2 

CM(0,) ’ 


where ||/||^^ = |V/|' dx, for all / G GM (H). Now, Pq = JvJ*v 


In fact, we have 


□ 


Corollary 6.2. CM (12) 0 J^Te (G) = {/ G CM (12) ; / {xj) = 0, 'ixj &V} (See also Lemma 
4.9.) 


Proof. The same as in the proof for the case of Brownian bridge: 

(■'G./)e„,„,=/(»>)• V/CCM(0). 

The desired result follows from this. □ 


Definition 6.3. Set 

res {xi, Xj) 


{Xi,Xj) 



-Kx 


||2 

WjifE 


K {xi, Xi) + K (xj,Xj) — 2K {xi, Xj) 


( 6 . 2 ) 


(We proved in [JPIO] that res {xi,Xj) in (6.2) indeed defines a metric on V; the so called 
resistance metric.) Let 

{Avf)ixi):= (/(^0 " / 

Xjr^Xi 

be the graph-Laplacian; where Xj ~ Xj iff (xiXj) G E. 


Theorem 6.4. Let P C 12 and Aq, K, MT {V) be as above; assume (6.1), i.e., finite neighbors 
in G. Then Sx, G Mf{V), and 

(Ay/) (x.) = {Sx ,, /)^(y) , WfGJi^iV). 


Proof. Follows from earlier analysis. One shows that 

1 \ 1 


- X! 


res {xi,xi) 


K.,- E 


res [xi, Xj) 


Kx^ GMf’iV). 


(It is a finite sum based on the assumption (6.1).) 


□ 


Remark 6.5. Let 12 C as above. If z/ > 1, then the kernel K (s,f), (s,t) G 12 x 12, has a 
singularity at x = y, by contrast to = 1 (see below.) But we can still construct discrete 
graph Laplacians. 

Fix 12, and let K be the kernel s.t. 

^( 2 :, •) Ian = 0, Va:Gl2, 

AK = 6 {s,y) = S {x - y), (a;, y) G 12 x 12 
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Figure 6.2. u = ks (t) = k (s^t). (A kernel function and its derivative.) 


where A = —as a s.a. operator on (17), with 

dom (A) = {/ e (f}) I A/ e {rt ), = 0 }. 

So K satisfies the Dirichlet boundary condition, but K has a singularity a,t x = y, i.e, 
diagonal of x n if > 1. 

Fix V = {xi}^ C n, discrete. Fix E C V x V\ (diagonal) s.t. Wxi G V, # {j \ Xj ' 
oo, finite neighbor sets. Set 

{Avf)ix,)= Y, res(l,,xj) ~ 

Xj 

X^r^Xj 

and get the corresponding energy-Hilbert space 

(V) = I / on y I YJ2 res(l x ) ~ ^ ^ f ' 


Example 6.6. For v = I, let 


k = s At — st 
ks (t) := k {s,t). 


Then, 

K (t) = (1 - s) X[o,s] (t) - sX[^.i] (f) 
-fc" (t) = 6s {t) = 6s^t 


, at the 
Xi} < 

(6.3) 

(6.4) 
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X* 



£) = ri = ja; S I |a:| < 1} 

dn = = {x \ |x| = 1} 


Figure 6.3. The case of = 2. x i-G- x*, reflection around S^. 


Example 6.7. For > 1, set A = —(a§”) ’ where 


Set 


V = grad = 


If ^ = 2 

n = {a; S I |a;| < l} 


s-‘ = {x e 1'I = !:"■’'? = '} 


and, V (a:, y) G O X fl, 


a 


K {x,y) = 


I \x-v\ 


-v\" {W\\x*-v\)'' 


where in (6.7), we set 


For 1 / = 2, see Fig 6.3. 
Special case of 


oo a; = 0. 


V >2 


v = 2 


K = G — Poisson 


(g (x,-) 


an 


where 


G{x,y) = 


-^log\x-y\ v = 2 


a 




V > 2. 


(Newton potential) 


(6.5) 


( 6 . 6 ) 


(6.7) 


( 6 . 8 ) 

(6.9) 
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Theorem 6.8. For n C bounded open, smooth boundary dfl, let mgQ be the surface 
measure (see [Tre06]j, then Aq with boundary condition f\gQ = 0 with 

domAo = [f ^ {Ft) | A/ e (Ft ), = O} 

is s.a., and with K as in (6.10), 

AK = 6 {s — y), {x,y) G Ft X FI 

with K {x, •) laQ = 0, Va; G F. 

Proof. For x,y G F, let Py be the Poisson kernel, and set 


K {x,y) = G{x,y) 


P. 


G{x,-) 


an 


view G {x,-) as a function on the boundary dF. We have 


( 6 . 10 ) 


Py G{x,-) 


Py (b) G {x, b) dmga (b), 


Jan 

where dmgQ (•) denotes the standard measure on the boundary dF of F-, see [Tre06]. 


Then 


FBy 


G{x,-) 


an 


is harmonic in F, and limy_,.{, Py G (x, ■) = G {x, b). So, from (6.10), 

K {x, b) = 0, Mx G F, b G OF, 
and so K in (6.10) is the Dirichlet kernel. 


□ 
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